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O ■ Abstract 

, Systems described by equations involving both multiplicative and additive 

noise are common in nature. Examples include convection of a passive scalar 
V/-^ ■ field, polymers in turbulent flow, and noise in dye lasers. In this paper the one 

o ■ 

. component version of this problem is studied. The steady state probability 

distribution is classified into two different types of behavior. One class has 

m , 

' power law tails and the other is of the form of an exponential to a power 

J>-,' law. The value of the power law exponent is determined analytically for 

Q , models having colored gaussian noise. It is found to only depend on the 

fH I power spectrum of the noise at zero frequency. When non-gaussian noise 



is considered it is shown that stretched exponential tails are possible. An 
^ , intuitive understanding of the results is found and makes use of the Lyapunov 

5r ! exponents for these systems. 
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I. INTRODUCTION 



This paper analyzes linear equations containing additive and multiplicative noise. There 
are many problems in physics which are in this category. The two types of noise are generally 
uncorrelated with each other. One example is a polymer in a turbulent flow. Analysis of this 
system yields an equation for bending modes of the polymer with two types of noise 
Thermal noise presents itself in an additive way, while the effects of the random velocity fleld 
come in multiplying the coordinates of the polymer, and is hence termed multiplicative. The 
random flow fleld, being turbulent, has correlations with long decay times, and are therefore 
highly colored. Other examples include motion of a passive scalar in a random velocity 
fleld , and propagation of light in random media . Noise in dye lasers is modeled by 
multiplicative random equations 0. Most of the applications involve more than one degree 
of freedom, however the multi-dimensional case is surprisingly similar to the one component 
case, so it is worth studying it flrst. The multi-component case is considered in a separate 
pubhcation 0. 

Because of its physical applications, it seems worthwhile to attempt to understand general 
properties of such equations. Drummond recently analyzed such a linear one component 
equation of the type of interest in this paper. He considered the case where both the additive 
and multiplicative noise where generated by the same random process. He found two types 
of behavior are possible. In one regime he found that the probability distribution function 
(PDF) had power law tails, so that high enough moments of the variable of interest did not 
exist. The other regime had all its moments deflned. 

In the applications mentioned above, the additive and the multiplicative noise are not 
correlated with each other which is unlike the cases considered by Drummond Fortu- 
nately this problem is also tractable analytically and is the subject of this paper. In this case 
one can go considerably further in classifying the type of behavior possible, and intuitively 
how it occurs. 

There is a large mathematical literature on the stability of the nth moment of a variable 
in the absence of additive noise which has been studied by the introduction of Lyapunov 
functions 0. The stability of moments can be determined if such a function can be found. 
The method can be extended to additive noise but does not provide a classiflcation of the 
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kinds of behavior expected for the tails of the distribution. 

The classification instead hinges on an important conceptual framework, the Lyapunov 
exponents for these systems without additive noise, as discussed in section |lll[ All the 
behavior found here is easily understood in this framework. In this case the PDF does not 
tend to a time independent limit, however the general scaling form of the distribution has 
been previously obtained [|l3;|nil and allows one to define a set of Lyapunov exponents L{q). 
These are not related simply to Lyapunov functions 0. The L{q)^s can then be used to give 
a more intuitive derivation of the form of the probability distribution's tail in the presence 
of additive noise discussed in the sections that follow. 

The classification into different two regimes is now briefly described. In one regime, it is 
possible to show that the probability distribution of fields satisfying these types of equations 
have power law tails. This class of problems occur under a wide variety of conditions. This 
will be seen first in section |T^ where a heuristic argument is given to understand when such 
tails are present and when they should be absent. Then, in section [V|, the one dimensional 
version of this problem with gaussian noise is analyzed. In general these power law tails 
will be present with Gaussian noise, even if it is not short range in time. In this case it is 
possible to find the exact exponent for the asymptotic probability distribution, for arbitrary 
time correlations in the multiplicative noise. The exponent depends continuously on the 
strength of the multiplicative noise in a simple way, only through the power spectrum at 
zero frequency. 

The other type of behavior is where all moments are defined and the PDF has a tail falling 



faster than any power law. This is shown in section ^ to occur for one dimensional models 
but requires that the multiplicative noise not be Gaussian. In this case the PDF will be of 
the form of an exponential to a power law, the precise exponent depending on the Lyapunov 
exponents for high moments. This can result in a stretched exponential distribution. 

II. ONE COMPONENT MULTIPLICATIVE EQUATION 
A. General equation for the moments 
Here we will consider the equation 
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flT 

V- = {-k + f{t))x+at) (1) 

This can be interpreted as the equation for a massless particle with friction coefficient i' 
connected to a spring that has a spring coefficient that varies randomly in time as A; — f{t). 
The spring is perturbed by a random force ^(t) representing a heat bath at temperature T. 



As a result the ^(t) is Gaussian and 6 function correlated (^(t)^(t')) = 2z/T5(t — t') [jT2 
/(t) in general can be considered non-Gaussian with a correlation function 

{mm) = g{t-t'), {fit)) = (2) 

Writing r = (A;/z/)t, this can be rewritten as 

^ = - X + 7(r)x + r7(r) (3) 
ar 



with 



and 



2T 

ivirUr')) = -^Kr-r') (4) 



(7(r)7(r')) = ^<7(^(r - r')). ^ a{r - r') (5) 



III. DISTRIBUTION IN THE ABSENCE OF ADDITIVE NOISE 

Here we will consider eqn. when the additive noise term rj is zero. In this case 
there is not a well defined steady state probability distribution. However it is useful to 
understand the time dependent form of the distribution for long times. We shall see that in 
this limit it has a scaling form. The main results found in this section will survive the leap to 
many components and provide an important conceptual framework for understanding these 
systems. 

First we review why it is that the behavior of the system is characterized by Lyapunov 



exponents 10,11 



{xit)") oc e^^"?)* (6) 
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where the brackets denote an ensemble average over the noise 7. To understand this, it is 
simplest to dispense with the linear term —kx in eqn. at the expense of giving 7(t) a 
nonzero mean (7) = — 1. A straightforward way of defining a short range non-gaussian 
process is to discretize the above eqn. t = iAt and using Ito discretization, this equation 
with rj = reads 

Xi+i = Xi{l + At-fi) (7) 

This defines a multiplicative process. If the different 7's are all taken to be independent the 
Lyapunov exponents can be determined by calculating 

(x,-?) = ((1 + At7i)^) = e^^-^)* (8) 

Hence the Lyapunov exponents are L{q) = (1/At) ln(((l + At'y)'^)). In general these are 
not quadratic and depend on the probability distribution of the 7i's. L{q) should be convex. 
These multiplicative random processes have been well studied, particularly in recent years 
in connection with "multifractals" . 

Given the moments of x it is possible to calculate its PDF for long times by performing 



a steepest descent analysis identical the case of multifractals |T0|. It can be checked that 
the distribution giving such scaling is 

InP(lnx) oct/((lna;)/t) + ) (9) 

t 

where 

f{a) = L{q)-qa, a = L'{q). (10) 

From this ((Inx)^) can be calculated and is proportional to t for large t, so the the 
distribution continues to broaden. Therefore P{x) does not tend towards a time independent, 
that is steady state, distribution. 

Do these results persist when there are correlations between the different 7^? The answer 
is that if the correlations are not too long range, these results are still valid. This can be 
seen by making an analogy with a statistical mechanical model. Denote the random variable 
1 + At7j in eqn. (|^) by exp(zj). Then given the joint PDF of the variables {zi, . . . , Zn} 
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P{^i,...,^4 = e-^^'''-'^"> (11) 

can be expressed as 

/n 
1=1 

This expression can be thought of as the partition function of a system with n degrees of 



freedom. For large n the free energy of this is extensive if V is sufficiently short range [|13 
This means that for large n {xn'^) ~ exp{nAtL{q)) where L{q) can be interpreted as the free 
energy per degree of freedom. 



IV. HEURISTIC EXPLANATION OF POWER LAW TAILS 

Before launching into a detailed mathematical analysis of this problem, it is worthwhile 
giving a heuristic explanation for the existence of power-law tails and their relationship to 
the Lyapunov exponents L{q). 

In the absence of additive noise, we just saw that eqn. (|^) can be characterized by the 
different moments of Xj. If we examine the qth moment (x^), it will either exponentially 
increase or decrease depending on whether L{q) is positive or negative respectively. 

Now examine how the last statement changes in the presence of additive noise. When 
L{q) is positive one expects that additive noise will only increase (xf) further. When L{q) is 
negative (xj) cannot be expected to go to zero as even in the absence of any multiplicative 
force (xf) should reach a non-zero steady state value. Therefore we expect that in the limit 
t ^ oo {xf) has a nonzero steady state value when L{q) is negative, and becomes ill defined 
when L(g) is positive. 

Consider fig. [T|. Here two examples of possible L{q)^s are illustrated. An important 
restriction to bear in mind is that L{q) is a convex function of q. The solid curve represents 
the case where L{q) changes sign as a function of q. q* represents the point where L{q*) = 0. 
From the above argument, for q > q* the moment (xf) becomes ill defined in steady state. 
Below this point the moments are well defined. Such behavior implies that the PDF of x 
has a power-law tail P{x) oc x^'^ 

The other case of interest is where L{q) never crosses through zero for positive q. In this 
case all moments are defined and P{x) should have a tail that vanishes more quickly then 
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any power. In this case, it does not seem possible to obtain the actual form for the tail of 
P{x) by the heuristic considerations just presented. However in section |V| a model will be 
analyzed where the form of the tail can be completely determined by a knowledge of L{q) 
for large q. 

The probability distribution with no additive noise, eqn. (|^) can be obtained from 
eqn. ( |T0|) with a knowledge of L{q). With the convex monotonically decreasing L{q) just 
considered, it can be seen from these equations that f{a) is only defined up to a finite 
maximum value amax- After this point, the probability distribution is zero. This means 
that L{q)'s of this type derive from highly non-gaussian multiplicative noise 7^ (cf. eqn. 
(0)). The probability distribution of 7^ must be zero beyond a certain value for this kind of 
curve, L{q). 



V. GAUSSIAN CASE 

We will now solve for the averaged moments of x{t). Since the noise is stationary, if a 
convergent moment exists then (a;"(r)) = {x^{0)). Solving eqn. (§) for a;(0) gives 

x(0) = /"e-/o(i-^W)^^r/(s)cis (13) 

The equation for the 2nth moment averaged over both 7 and t] is 

JO Jo 

Now we take 77 to be to be gaussian white noise so that Wick's theorem can be applied to 
the right hand side to separate out the average into all possible combinations of two point 
correlation functions. Each term gives the same contribution so one obtains 

M:(^)" r... r(e-ar(i-^W)'^-)5(si-s„+i)---5(s„-S2„)rfsi...rfs2„ (15) 
/"n! k Jo Jo 

Now the limits of integration can be restricted to si > S2 . . . > s„ > at the expense of 
multiplying by n\, as each possible ordering of the Sj's gives an equal contribution. The 
average with respect to 7 of the exponential can also be performed. This gives 

(x^"(0)) = 

(2n)! r r ■■■ e-2ELi^« + 2 U sis).is-s')sis')dsds' _ _ _ /^g) 

k Jo Jo Jo 
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Here we use the Heaviside function 6{s) to write 

n 

Sis) = (17) 

i=l 

This has the form of a staircase. 

A. White noise correlations 

Before we proceed to analyze the case of general correlations in 7, we examine the case 
where 

a(r-r') = a„(5(r - r'). (18) 

A differential equation for the time evolution of the probability, P{x, t) can be derived and 
has the form of a generalized Fokker-Planck equation |]14| . 



The steady state solution corresponding to zero particle current, that is, no particles being 
created or destroyed at the boundaries, is found by setting the expression to the right of the 
^ equal to 0. Solving this gives 

P{x) oc ^ — ^ (20) 

A related three dimensional version of this has been derived in the context of polymers 
in turbulent flow It shows that the large x behavior of P{x) has a power law tail 

P{x) ~ x"^"^/*^". We can check that eqn. (|T6|) is correct by substituting eqn. (|T8|). into it. 
One can then decouple all of the Si integrations by making the change of variables 

Ai = S2 — Sl, A2 = S3 — S2, . . . A„_i = Sn — Sn-1, A„ = Sn (21) 

So the right hand side of eqn. (|T^) becomes 

(2n)! ^2T^„ r . . . r gE:Li(-2^A.+2..i^A,)^^^ ^ ^ ^ (22) 

fC Jo Jo 
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Performing the intergration gives 
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(a;2-) = ^(L)nfT^_ (23) 

This can be compared with the answer obtained from eqn. (pO|) by computing moments. 
The integrals can be done in closed form and give the identical result. 

Clearly the precise form of the moments (x^"), and hence P{x), is dependent on the 
whole function 0"(s). However we shall now see that the large x behavior of P{x) only 
depends on the total under a(s). 



B. General Asymptotic Behavior 

To determine the power law exponent of P{x) for large x, for general correlations cr(s), 
one locates at which value of n eqn.(|T6|) becomes divergent. That is if we define a so that 
P{x) oc for large x, then (x^") becomes divergent when 2n — a = — 1 or a = 2n + 1. 
For example for short range correlations, eqn. (^), becomes divergent when n = I/cTq- 
Therefore a = 1 + 2/ao, in agreement with eqn. (^). Therefore the object of this section 
is to locate the value of n where eqn. (|TB|) becomes divergent, for general but normalizable 
a{s). 

To do this we rescale the Si in eqn. ( [T6| ) 

S = S1P2 = — , P3 = — , • • • Pn = — (24) 

Si Si Si 



so that 



(x'") = (2n)!(-)" / s"-iF(s)rfs 
k Jo 

F(s) = r' ... T" e / ^(p)<^P+2^' / / R{ph{s{p-p'))R{p')dpdp' ...dpn (25) 

JO JO JO " 

R{p) = 9il-p) + j20ip^-p) 

i=2 

The divergence in {x'^'^) is therefore controlled by the large s behavior of F{s). For large s 
the function cr{s{p — p')) becomes very sharply peaked. One can define a limit of functions 
approaching a 6 function by 

lim a(s(p-p')) = (26) 

S^OO g 
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ao = / a{p)dp (27) 



For large s, the leading order term in the exponent of the integrand is identical to the short 
range case 

- 2s[ J R{p)dp -(^oj J R{p)S{p - p')R{p')dpdp' + 0{l/s^)] (28) 

Where the exponent P > depends on the form of o"(s). As n increases, the staircase 
function R{p) becomes larger. Since the second term is quadratic, and the first term, linear 
in i?, for large enough n ithe expression inside the square brackets becomes positive so that 
the entire expression will increase linear with s, for some values of the p^'s. This leads to 
a divergence. Lower order corrections in s, cannot change this point of divergence as it is 
determined by the sign of the slope of this expression for large s. 

Therefore for large s, F{s) will only depend on cTq, the total area under (j{s). 



VI. SHORT RANGE NON-GAUSSIAN NOISE 



We now relax the restriction that the multiplicative noise be Gaussian, but restrict 
the analysis to the case of short range correlations. In section |IT1| eqn. was discretized. 
With additive noise included it can also be solved in discretized form, but the results are 
very similar looking to the continuous case. We can, with little loss of generality use the 
continuous form of the equation to analyze this problem. With continuous notation the 
equation for the Lyapunov exponents read 

(e'?/oTW'^") = e^(«)* (29) 

Defining D = 2T/k we can still salvage the previous calculation up to eqn. (pIS]), with 

(7(r) — 1) — > 7(r), and have 

(.(0)-> = Mz,"r...r(e^EL./;SW..),,^.„,,„. (30) 

Using the change of variables of eqn. (^11) and also eqn. (^) defining the Lyapunov expo- 
nents, this yields 

(a;(0)2-) = Ml/)" r eELi ^(20A.rfA^ . . . rfA^ (31) 
2 ^0 

Performing the integrations over the Aj's gives the final answer 
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{x{Or) = (2n)!(-) nrZ(^ (32) 

The above analysis has assumed that the discretization time step At is very small so that 
L{q)At is small. Similar expressions to above can be derived for the discretized case without 
this restriction on At which amounts to replacing the last integration over the A's by a 
discrete summation. This gives 

D " At 

(x(0)-) = (2n)!(-)"nY— (33) 

A. Relation between the distribution and L(q) 

By knowing the moments of x one can obtain its PDF. Now that we have an expression 
for the moments eqn. (32) as a function of the Lyapunov exponents L{q), we can consider 



the problem of how different forms of L{q) affect the probability distribution of x. Different 
forms of L{q) were shown in fig. and discussed in section 0. The solid line in this figure 
represents the case of finite q*, the point beyond which the Lyapunov exponents become 
positive. In this case eqn. (|3^) implies that for 2n > q* the moments are not defined, for q* 
an integer. This implies that the p.d.f. has a power law tail P{x)dx = x^'^*^^. This is in 
agreement with the results found earlier for Gaussian multiplicative noise, and the heuristic 



argument of section [V 



The other case to consider is when L{q) is always negative for positive q. Consider the 
case where the asymptotic form of L{q) for large q is proportional to —q^. The restriction of 
convexity implies < (3 < 1. To find the tail of P{x), one starts by substituting L{2i) = — 
in eqn. (p2D and uses Stirlings approximation to simplify the expression. 

(^^q^ ^ gg(ln(q)-l)-/3(g/2){ln(q/2)-l)+C9 ^3^^ 

where C is a constant whose value will not be important in the conclusions to this analysis. 
The asymptotic form of P{x) can be obtained by a steepest descent analysis. In general 

exp(D(g)) = (x") = J P{x)x'^dx (35) 

Changing variables in the last integration to m = Inx and performing steepest descent, which 
is vahd for large q, one has D{q) = f{u{q)) + qu{q). Here exp(/(lnx))(i(lna;) = P{x)dx and 
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u = u{q) is determined by the saddle point equation df /du = —q. We want to solve for f{u) 
which can be done by Legendre transform to a different "ensemble" directly borrowing this 
method from thermodynamics. Then f{u) = D{q) — qu and dD/dq = u. Carrying out out 
the algebra yields the result 

P{x) oc e-^^'^'^-'' (36) 

where i^' is a constant. This is stretched exponential behavior. An application of this to 
experimental systems will be discussed in the following paper 0]. Note that when (3 —>■ 0, 
the tail becomes exponential. The limit where L{q) approaches a constant for large q, 
corresponding to /5 = 0, has qualitatively different behavior for f{a) defined in eqn. ^ for 
finite /?. In the former case f{a) goes to negative infinity at a finite value a = amax, whereas 
in the latter case /(a) goes to a finite value at a = amax- 



VII. CONCLUSIONS 

The PDF for eqn. has been analyzed in one dimension under a variety of conditions, 
long range time correlations with gaussian statistics, and nongaussian noise with short range 
temporal correlations. It has been possible to classify the steady state PDF's with additive 
noise by examining the Lyapunov exponents. When the Lyapunov exponents L{q) pass 
through zero at finite q, the tails are power law. The exact exponent was worked out for 
Gaussian multiplicative noise and was found to be independent of the strength of the additive 
noise. If the Lyapunov exponents remain negative for all positive q it was argued that the 
PDF, P(x) should be of the form logP(x) oc —x^ where p is a power between and 2. 

It is interesting to note that many of the conclusions here hold for coupled many com- 
ponent equations of the same form. This will be seen in the following paper. 
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FIGURES 

FIG. 1. Examples of two different L(g)'s. The solid line represents an L{q) that intersects the 
horizontal axis at finite q. The dashed line represents one that does not. 
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